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Soon after the first QSO was identified, Gunn & Peterson^ searched for the 
expected characteristic absorption trough on the blueward side of Lya in the 
spectrum of the QSO due to an Intergalactic Medium (IGM). They failed to 
find it, placing a constraint on the density of neutral hydrogen in the IGM 
that was less than 1 part in 10'' of that residing in galaxies, and concluded 
that the IGM must be highly ionized. Soon afterwards absorption by Lya was 
detected in the IGM; not by a diff"use component, but by a clumpy component 
of intergalactic gas clouds, the Lya forest^'^. The goal then became to search for 
'excess' absorption beyond that expected from the forest. No clear absorption 
by a diflFuse H I component, however, was ever detected^ ''. The results of recent 
numerical hydrodynamics computations of the formation of the Lya forest appear 
to indicate that the division between a clumpy component and a diflFuse one may 
be inappropriate. We find that in a CDM-dominated cosmology, no substantial 
diff"use medium should be expected. Instead, the medium condenses into a 
network of complex structures that reveal themselves as discrete absorption 
systems in the spectra of QSOs. The lowest column density lines arise from the 
fine structure in minivoids — small regions with densities below the cosmic mean. 
These results suggest that the long sought for diff'use H I Gunn-Peterson eff'ect 
may not exist. 
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Recent ground and space measurements of intergalactic absorption in the spectra of 
high redshift QSOs have considerably expanded our knowledge of the structure of the IGM. 
Keck observations^'^ have revealed that the forest extends to H I column densities as low as 
A^jjl ~ lO-'^^cm"^, while the Hubble Space Telescope^ and the Hopkins Ultraviolet Telescope 
(Davidsen et al., submitted to Nature), have made the first detections of intergalactic 
He II . The Keck data show no conspicuous absorption by a diffuse H I component at 
z ~ 3. Absorption by diffuse He II in the IGM is expected to be more easily detected 
than H I because of its higher density, however it is unclear whether the He II detections 
were of a diffuse component or of the He II content of the Lya forest^. Indeed, Keck 
observations suggest the latter may account for the measured opacity without invoking an 
unreasonably steep photoionizing background radiation field. In agreement with ground 
based H I observations, no diffuse component appears to be required. 

We analyze the results of a recent cosmological hydrodynamics simulation of the 
formation of the Lya forest in a Cold Dark Matter (CDM) dominated cosmology by Zhang, 
Anninos & Norman -'^-'^ and derive their implications for H I and He II absorption. For much 
of our discussion, we have rescaled the ionization fractions to the metagalactic radiation field 
recently determined by Haardt and Madau"*^^ (HM) on the basis of QSO counts, including 
the re-emission from the forest and Lyman-limit systems. The rescaling should have little 
impact on the cloud properties other than on their ionization state, at least for the column 
density range of interest here. We show the distribution of gas density in Figure 1. For 
the density threshold shown, the IGM appears as a network of filaments, with a typical 
coherence length of 1-2 Mpc and thickness 100-200 kpc. These scales are comparable to 
the recent size estimates based on neighboring QSO pairs^"^'"*"^. In between the filaments are 
underdense regions, or cosmic 'minivoids.' 

To translate the H I density into spectra, we lay down random lines of sight through 
the box and determine the absorption features that would be observed in a background QSO. 
We then identify absorption features with optical depths exceeding 0.2, de-blend the features 
into individual lines, fit the lines and extract the column densities and Doppler widths 
using a curve-of-growth analysis, as described by Zhang, Anninos, Norman, & Meiksin (in 
preparation). The column density distribution matches the observed distribution in shape 
remarkably well, as has been found in other simulations for CDM (Hernquist et al. submitted 
to Astrophys. J) and CDM -|- A-*^^ cosmologies. The number of systems per unit column 
density varies as a power law, dN/dNvj oc N-^ , with /3 ~ 1.5 for iVjji < lO^^cm"^, in 
agreement with findings from the Keck . There is an essential uncertainty in the H I column 
densities, however, resulting from the unknown ionization fractions. The neutral fraction 
is proportional to fcjon = (^6^5o)^/'^912 (for clouds optically thin at the H I Lyman edge), 
where J912 is the background intensity at the H I Lyman edge. This acts effectively as an 
'ionization bias' relating the neutral hydrogen column density of an absorber to its total 
hydrogen column density. Defining b[Q^ = 1 for ^b^'^o — 0-06 and the HM vahic for the 
background intensity, we find that rescaling the background radiation to 6j™ = 1.5 matches 
the number density of iVjji > 10^"^ cm~^ systems measured by the Keck at z = 3. We 
assume this value throughout. It is noteworthy that this value would place the required 
fljj close to the nucleosynthesis upper limit^^ of ^b^50 < 0-08 for the HM spectrum. If the 
metagalactic radiation field much exceeds the estimated contribution from QSOs, or if the 
density of baryons is lower, as suggested by some recent deuterium measurements in high 
redshift absorption systems-*^^, then this cosmological model would appear to be in conflict 
with the measured numbers of clouds in the Lya forest. 
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A wide range of local densities is responsible for the absorbers. In Figure 2 we show 
the average column density as a function of the local average density, normalized by the 
average cosmological value. Those systems which are optically thin at line-center arise in 
minivoids. In fact, we find that at redshift z — 3 more than 70% of the baryons reside in 
overdense regions, while the remainder, in underdense regions, produces most of the low 
column density (10"'^"'^ — 10"'^'^ cm^^) systems. These results suggest that the long sought for 
diffuse component of the IGM may not exist, but that clumping is ubiquitous, even in regions 
at the average cosmic density and below. The view that QSOs dominate the background 
UV radiation field and that the Lja forest captures most of the baryons at 2; > 2 is fully 
consistent with current observations"'^^' This view differs dramatically from the prevailing 
model of the IGM in which the Lya forest is composed of clouds embedded in a pervasive 
diffuse medium that survived the onset of structure formation at high redshift and contained 
the majority of the baryons created during the Big Bang. 

Most of the absorption in a QSO spectrum shortward of Lja results from line- 
blanketing, the stochastic overlapping of absorption features. Searches for the Gunn- Peterson 
effect have been attempts to detect excess absorption above that due to the forest^'^. Since 
the forest extends to very low column densities, however, the distinction between the two 
becomes somewhat semantic. But while line-blanketing and optically thin 'Gunn-Pctcrson' 
absorption are related, they are not identical. The connection may be made concrete 
by appealing to the effective opacity r^fj, defined by exp(— Teff) = (exp(— Tz/)). For line- 
blanketing-*^^, 

1 + z f d'^N 



for a cloud distribution of redshifts and rest-frame equivalent widths d'^N/ dzdW . Restricting 
the range to optically thin clouds at line-center gives Tgff — > Tqp^, where T^p^ is the Gunn- 
Peterson opacity corresponding to the spatially averaged neutral hydrogen density (tt-jjj'^) of 
the optically thin systems'^'^'-'^, 

thin _ (^HI™) /r,\ 

(1 + .)(1 + 2^0^)1/2' 

where is the frequency integrated absorption cross-section^-'. According to Figure 2, 
clouds of unit optical depth correspond to regions near the average cosmological baryon 
density. Thus, we may identify the H I Gunn-Peterson effect with the optically thin tail of 
the Lyo; forest. By contrast, the opacity resulting from the high column density systems 
measures the product of the Doppler parameter of the clouds and their number per unit 
line-of-sight, above a given column density, or line-center opacity, threshold. This is because 
an optically thick cloud enters the fiat part of the curve-of-growth, for which the equivalent 
width is proportional to the Doppler width and insensitive to the H I density. (Note, though, 
that the number of clouds above a fixed opacity threshold is sensitive to the internal cloud 
H I density.) The physical distinction in the character of these two limits may be exploited 
to test two different aspects of the nature of the clouds and their evolution. In Figure 3a, 
we show the evolution of for optically thin (0.2 < rg < 1 and 0.5 < rg < 1) and optically 
thick (tq > 10) systems. We also show the contribution from all the clouds with rg > 0.2. 
(Only clouds optically thin at the Lyman edge are counted since we have not corrected for 
radiative transfer effects.) We find good agreement with the expected amount of blanketing 
inferred from observations over the limited redshift range currently available. 
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A quantity closely related to the effective opacity is D^, the flux decrement in a QSO 
spectrum between Lya and Ly/3 

5 1 f^Q 

= 32(rT^i,27/32)(l+.«)-l[l-^'^P(-''^"''^' ® 

where zq is the redshift of the QSO. In Figure 3b, we show the evolution of obtained from 
the simulation, including cuts based on overdensity. The distinction between the optically 
thin and optically thick absorbers is clear: the absorption due to the optically thin material, 
occupying regions near the average cosmic density, behaves like the Gunn-Peterson opacity 
for tqp <^ 1. We also compute Dg, the decrement between Ljf3 and the Lyman limit . We 
find Dr/Da = (1-1, 1-2, 1.2, 3.3) for z = (2, 3, 4, 5), compared to the average measured 
ratios^^'^"^ of 1.5 at 2; = 3 and 1.2 at 2; = 4. 

The recent determinations of the He II Lya opacity, T304, may be used to constrain 
the shape of the background UV radiation field . The He II opacity predicted, however, 
requires an extrapolation of the H I column density distribution to lower than measured 
values as well as knowledge of the unmeasured He II Doppler parameters^. These quantities 
are predicted by the simulation, and so it is of interest to infer the constraint on the radiation 
field the simulation implies. In Figure 4, we show the evolution of r304 for different values of 
the softness parameter Sj^ = ^912/^228) the ratio of intensities at the H I and He II Lyman 
edges. We find that in order to match the observed values, Sj^ > 60 is required, a value 
consistent with a QSO-dominated UV background, though for a somewhat soft intrinsic QSO 
spectrum {a ^ 1.5)^. A He II opacity of r304 > 2 at 2; = 3 would be difficult to reconcile 
with a QSO dominated background. It would then be necessary to appeal to additional 
sources of H I ionization, like an early generation of stars or decaying neutrinos^^. 

We point out that substantial fluctuations in the opacity are expected on small scales, 
as shown in Figure 1. These fluctuations result from the large density fluctuations expected 
on small scales in a CDM cosmology. While most of the H I blanketing arises from systems 
in regions near the average cosmological density, the He II blanketing is dominated by the 
smaller scale systems in the underdense regions. The He II opacity thus serves as a probe of 
the minivoids. 

We conclude that the IGM may be highly clumped, with a negligible baryon fraction 
residing in a diffuse component. It is for this reason that a diffuse component may have 
evaded detection in the form of the Gunn-Peterson effect. The canonical picture of the IGM 
in which the absorption clouds are embedded in a diffuse background medium is not viable in 
a CDM dominated cosmology. It is replaced by a continuous spectrum of dumpiness: from 
the high overdensity halos which give rise to the high column density absorption lines, to the 
mildly overdense filaments which give rise to the intermediate column density absorbers, to 
the underdense minivoids which are responsible for most of the low column density systems 
that have just recently been discovered. 
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Figure Captions 



Fig. 1. — Distribution of the gas density at 2; = 3 from a numerical hydrodynamics 
simulation of the Lya forest. The simulation adopted a CDM spectrum of primordial 
density fluctuations, normalized to the second year COBE observations, a Hubble constant of 
Hq = SOkms-^Mpc-^ a comoving box size of 9.6 Mpc, and baryonic density of = 0.06 
composed of 76% hydrogen and 24% helium. The region shown is 2.4 Mpc (proper) on a 
side. The isosurfaces represent baryons at ten times the mean cosmic density (characteristic 
of typical filamentary structures) and are color coded to the gas temperature (dark blue = 
3 X 10^ K, light blue = 3 x 10^ K). We note that higher density contours trace out isolated 
spherical structures typically found at the intersections of the filaments. A single random 
slice through the cube is also shown, with the baryonic over density represented by a rainbow- 
like color map changing from black (minimum) to red (maximum). The He II mass fraction 
is shown with a wire mesh in this same slice. Notice that there is fine structure everywhere. 
To emphasize the fine structure in the minivoids, we have rescaled the mass fraction in the 
overdense regions by the gas overdensity wherever it exceeds unity. 

Fig. 2. — Distribution of H I column density of the clouds as a function of the local baryon 
overdensity. The vertical solid line is the dividing line between the overdense and underdense 
regions. The horizontal dashed line represents the column density A^jjl = 10^^"^ cm~^ above 
which the H I opacity at the Lyman edge exceeds 0.5 and radiation transport effects become 
important. Discrete absorption systems exhibit the full range of densities, and arise even 
in regions that are underdense. The clouds become optically thin in Lja at line-center for 
Njii ^ 10^^ cm~^. Optically thin systems occur predominantly in the underdense regions, 
although there is a smooth transition between optically thin and thick absorbers. 

Fig. 3. — (a) Effective opacity TqQ for optically thin (0.2 < tq < 1 and 0.5 < rg < 1) 
and optically thick {tq > 10) Lya clouds. (A lower limit of tq > 0.5 for the thin systems is 
required to avoid incompleteness in the Keck data.) While the optically thin opacity traces 
the spatially averaged neutral H I density of the clouds, the opacity based on the optically 
thick systems traces the Dopplcr width and number of the clouds per unit line-of-sight, 
since the equivalent width of a saturated line is given by^l W ~ (26/c)Ao(logro)l/2, nearly 
independent of tq, the line center opacity. These opacities test independent properties of the 
clouds, and both agree closely with the measured values from Keck observations^. We also 
show the full contribution of all the lines with tq > 0.2 to the effective opacity. These vahies 
again agree well with the estimate from the Keck data, (b) H I flux decrement D^ due to 
H I Lya absorption. The contributions from several overdensity cuts are shown separately, 
corresponding closely to cuts in H I column density. The measured values^"^"^^ compare 
well with the simulation results. We note that the agreement for z > 3 may be improved 
by allowing for an additional contribution to the UV background from QSOs obscured by 
dust in damped Lya systems"^^. The thin solid line shows the contribution to D^ from the 
lines, computed as Dl = 1 — exp(— r^g-). This indicates that the decrement is due almost 
entirely to line-blanketing. Also shown (dotted line) is the Gunn- Peterson opacity obtained 
by summing the contribution to the absorption from underdense regions as in equation (2), 
and expressed as a flux decrement Dgp. The Gunn- Peterson value correlates strongly with 
the contribution of the underdense material to D^ for rgp <^ 1, demonstrating that the 
H I in the underdense regions is optically thin in Lya . Accordingly, the absorption arising 
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from the underdense regions may be associated with the Gunn-Pctcrson effect. Its small 
value reflects the small fraction of the baryons residing in the underdense regions. 

Fig. 4. — He II Lja opacity using the numerical data rescaled by the Haardt & Madau-*^^ 
radiation spectrum, with b[Q^ = 1.5. We reduce the He II spectrum amplitude with respect to 
the H I by factors of 2, 5 and 10 over the KM spectrum, corresponding to softness parameters 
of S]^ = 60, 200 and 400 respectively. The cross is the la result of 3.2, with an error of 
(+00, —1.1), at 2; = 3.2 from the HST FOC observation of Jakobsen et al.^ and the filled 
square is their 90% confidence lower limit of 1.7. The filled circle is from the ASTRO-2 HUT 
observation of Davidsen et al. (submitted to Nature) of 1.00 ± 0.07 at an average redshift 
< z>= 2.4. 
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